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(54) METHOD/SYSTEM FOR REMOTE CONTROL AND PROGRAM FOR REMOTE CONTROL SYSTEM 

(57)Abstract: 

PROBLEM TO BE SOLVED: To provide a remote control system capable of 
realizing the remote control of home facility at a low cost and easily realizing 
remote monitoring of home and other additional function. 
SOLUTION: Inside of the residence 2, there exist household electric 
appliances 6, 7 and 8 such as a television receiver, a VTR, an air 
conditioner as appliances to be operated. Inside of the residence 2, a robot 
5 having the same transmission and reception function as that possessed 
by a portable terminal 1 in a portable telephone system and capable of 
moving inside of the residence 2 is placed. A user remotely controls the 
robot 5 with the terminal 1 to remotely control the appliances 6, 7 and 8. 




S 

. V, 


\ 


<0 


oi' 






ts 


St 


at 




ft 


: 


* 




m 


-r 






a 



□ 



LEGAL STATUS 

[Date of request for examination] 

[Date of sending the examiner's decision of rejection] 

[Kind of final disposal of application other than the examiner's 
decision of rejection or application converted registration] 

[Date of final disposal for application] 

[Patent number] 

[Date of registration] 

[Number of appeal against examiner's decision of rejection] 

[Date of requesting appeal against examiner's decision of 
rejection] 



13.03.2006 



http://vvww19jpdl.ncipi.gojp/PA1/result/detail/main/w 7/31/2006 



Searching PAJ 

[Date of extinction of right] 



Page 2 of 2 



http://wvvw19Jpdl.ncipi.gojp/PA1/result/detail/main/wAAAQ6aWabDA414281567... 7/31/2006 



JR,2002-281567,A [CLAIMS] 



Page 1 of 1 



* NOTICES * 

JPO and NCIPI are not responsible for any 
damages caused by the use of this translation. 

1 .This document has been translated by computer. So the translation may not reflect the original precisely. 
2.**** shows the word which can not be translated. 
3. In the drawings, any words are not translated. 



CLAIMS 



[Claim(s)] 

[Claim 1] The remote-operation approach that place into ** the migration equipment which can move according to the command which has 
the control unit which operates an operated device and received through the communication line, connect the personal digital assistant and 
said migration equipment besides ** through a communication line, and delivery and said migration equipment operate an operated device 
for a command from said personal digital assistant according to the command from said terminal unit to said migration equipment. 
[Claim 2] It has the personal digital assistant which has an image transceiver function and a voice transceiver function, and said personal 
digital assistant and migration equipment which transmit and receive information through a communication line. Said migration equipment 
The communications control section which communicates with said personal digital assistant through said communication line, and the 
device section for migration, The device control section which controls said device section according to the operating command which said 
communications control section received through said communication line from said personal digital assistant, Said personal digital 
assistants are the remote control systems containing the command section which gives a command to said migration equipment through 
said communication line including the control unit which operates an operated device according to the operator command which said 
communications control section received through said communication line from said personal digital assistant. 

[Claim 3] They are the remote control systems according to claim 2 which transmit the image obtained by migration equipment picturizing 

including the image pick-up section to a personal digital assistant through a communication line, and contain the display as which a 

personal digital assistant displays the image received from said migration equipment through the communication line. 

[Claim 4] For said speech recognition section, migration equipment is remote control systems according to claim 2 or 3 which recognize an 

operating command with the voice which the communications control section received through the communication line from the personal 

digital assistant, and transmit a recognition result to a device control section including the speech recognition section. 

[Claim 5] The speech recognition section is remote control systems according to claim 4 which recognize operator command with the voice 

which the communications control section received through the communication line from the personal digital assistant, and transmit a 

recognition result to a control unit. 

[Claim 6] Migration equipment is claim 2 which outputs the information containing the image memorized by said storage section to said 
communications control section so that it may be transmitted by said personal digital assistant thru/or remote control systems according to 
claim 5 according to the demand command which has the storage section which memorizes the information containing an image, and the 
communications control section received through the communication line from the personal digital assistant. 

[Claim 7] Migration equipment is remote control systems according to claim 6 which are the information containing the image which the 
communications control section received through the communication line from the personal digital assistant, and memorize the information 
ordered so that it might memorize in the storage section. 

[Claim 8] As for a personal digital assistant, said image pick-up section transmits the image picturized and obtained to migration equipment 
through a communication line including the image pick-up section. Migration equipment The image recognition section which performs 
image recognition based on the image received through a communication line and the communications control section from said personal 
digital assistant is included. Claim 2 which accepts the command from said personal digital assistant when in agreement with the portrait 
image with which the recognition result of said image recognition section is memorized beforehand thru/or remote control systems 
according to claim 7. 

[Claim 9] Migration equipment is claim 2 outputted to said communications control section so that the information which shows that 
abnormalities arose including the sensor when abnormalities were detected by said sensor may be transmitted by said personal digital 
assistant thru/or remote control systems according to claim 8. 

[Claim 10] Migration equipment is claim 2 which has an autonomous operation function thru/or remote control systems according to claim 
9. 

[Claim 1 1] To the computer which said migration equipment in remote control systems equipped with the personal digital assistant which 
has an image transceiver function and a voice transceiver function, and said personal digital assistant and migration equipment which 
transmit and receive information through a communication line has The analysis feature which analyzes the command received through 
said communication line from said personal digital assistant, The device control function which controls the device section for migration 
based on the command analyzed by said analysis feature, The image transmitting function which addresses the image picturized and 
obtained based on the command analyzed by said analysis feature to said personal digital assistant, and transmits, The program in Remote 
Control System for realizing the actuation function to operate an operated device based on the command analyzed by said analysis feature. 



[Translation done.] 
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DETAILED DESCRIPTION 



[Detailed Description of the Invention] 
[0001] 

[Field of the Invention] This invention relates to the program in the remote-operation approach that 
the user who exists out of ** can operate operated devices, such as a household-electric-appliances 
device currently installed in **, by remote control, remote control systems, and Remote Control 
System. 
[0002] 

[Description of the Prior Art] Dr awing 10 is the block diagram showing the conventional remote- 
operation structure of a system indicated by JP,2-35560,U. With the configuration shown in drawing 
10 , the facilities 22, 23, and 24 in a residence of an electric light, an air-conditioner (air- 
conditioner), etc. are installed in the interior of a residence 2. Moreover, the facilities 22, 23, and 24 
in a residence are connected to the home controller 21. The home controller 21 is connected to the 
dial-up line network 30 through the telephone line while it can check the situation of the facilities 22, 
23, and 24 in a residence of operation or can perform a setup of operation. 

[0003] In the location distant from the residence 2, a user can connect the tele controller 10 to the 
telephone line, and can access the home controller 21 through the dial-up line network 30. And a 
user transmits a concrete command to the home controller 21, after transmitting a password. The 
home controller 21 will perform control according to a command, if a just password is received. For 
example, the situation of the facilities 22, 23, and 24 in a residence of operation is transmitted to the 
tele controller 10. The tele controller 10 displays by receiving the situation of the facilities 22, 23, 
and 24 in a residence of operation. A user can check the situation of the facilities 22, 23, and 24 in a 
residence of operation by the display of the tele controller 10. Moreover, a setup of the facilities 22, 
23, and 24 in a residence of operation can be directed to the home controller 21 through the tele 
controller 10. Therefore, in the location distant from the residence 2, the situation of the facilities 22, 
23, and 24 in a residence of operation can be checked, or a user can perform a setup of the facilities 
22, 23, and 24 in a residence of operation. 

[0004] In addition, there are image transcription reservation of VTR, closing motion of a key, a 
kettle of a bath, etc. other than an air-conditioner or an electric light as a controlled system of the 
home controller 21. 
[0005] 

[Problem(s) to be Solved by the Invention] Since the conventional remote control systems are 
constituted as mentioned above, construction which wires between the home controller 21 and the 
facilities 22, 23, and 24 in a residence must be performed, and the cost for realizing remote control 
systems becomes high. Moreover, it will be necessary to install the home controller 21 and the 
facilities 22, 23, and 24 in a residence which have the function to perform informational transmission 
and reception, or to add the interface circuitry for performing transmission and reception of the home 
controller 21 and information to the facilities 22, 23, and 24 in a residence, and the facilities 22, 23, 
and 24 in a residence will also become expensive. Furthermore, when a user wants to check the 
situation inside a residence 2 or to realize the monitor of the uninhabited residence 2 out of**, 
separately, a camera etc. will have to be installed, or a crime prevention contractor will have to be 
requested, and costs will start too. 

[0006] Then, this invention aims at offering the program in the remote-operation approach that the 
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addition function of the remote monitor and others in ** is easily realizable, remote control systems, 
and Remote Control System while it can realize remote operation of the facility in ** by the low 
price. 
[0007] 

[Means for Solving the Problem] The remote-operation approach by this invention places into ** the 
migration equipment which can move according to the command which has the control unit which 
operates an operated device and received through a communication line, and connects the personal 
digital assistant and the migration equipment besides ** through a communication line, and it carries 
out that delivery and migration equipment operate an operated device from a personal digital 
assistant according to the command from a terminal unit for a command to migration equipment as 
the description. 

[0008] Moreover, the personal digital assistant with which the remote control systems by this 
invention have an image transceiver function and a voice transceiver function, The communications 
control section in which is equipped with a personal digital assistant and the migration equipment 
which transmit and receive information through a communication line, and migration equipment 
communicates with a personal digital assistant through a communication line, The device section for 
migration, and the device control section which controls the device section according to the 
operating command which the communications control section received through the communication 
line from the personal digital assistant, A personal digital assistant is characterized by including the 
command section which gives a command to migration equipment through a communication line 
including the control unit which operates an operated device according to the operator command 
which the communications control section received through the communication line from the 
personal digital assistant. 

[0009] The program in the remote control systems by this invention The analysis feature which 
analyzes the command received from the personal digital assistant through the communication line 
to the computer which the migration equipment in remote control systems has, The device control 
function which controls the device section for migration based on the command analyzed by the 
analysis feature, It is characterized by realizing the image transmitting function which addresses the 
image picturized and obtained based on the command analyzed by the analysis feature to a personal 
digital assistant, and transmits, and the actuation function to operate an operated device based on the 
command analyzed by the analysis feature. 
[0010] 

[Embodiment of the Invention] Hereafter, the gestalt of operation by this invention is explained with 
reference to a drawing. Drawing 1 is the system configuration Fig. showing the gestalt of operation 
of the 1st of the remote control systems by this invention. In the system shown in drawing 1 , the 
electrical home appliances (home electronics) 6, 7, and 8 as an operated device exist in the interior of 
a residence 2 (inside of **). Home electronics 6, 7, and 8 are a television receiver (TV), VTR, and an 
air-conditioner. Moreover, into **, it has the same transceiver function as the transceiver function 
which the personal digital assistant in a cellular-phone system has, and the robot 5 as migration 
equipment which can move in the inside of ** is placed. In addition, keys, such as home electronics 
6 and 7, hot water heaters other than eight, and a door, and other housing devices can also be used as 
an operated device. 

[001 1] A personal digital assistant 1 can access a robot 5 through the radio networks 3, such as a 
WCDMA method. A personal digital assistant 1 contains the display 1 1 by a liquid crystal display 
etc., the control unit 12 containing a ten key or other keys, and a camera 13. Of course, the personal 
digital assistant 1 is equipped with the circuit for performing the communication link by the 
microphone, the loudspeaker, the antenna, a WCDMA method, etc. In addition, a control unit 12 also 
plays a role of the command section which gives a command to a robot 5. Moreover, when a 
command is made by voice, a microphone also plays a role of the command section. 
[0012] Drawin g 2 is the explanatory view showing an example of a robots 5 appearance. A robot 5 
is an interactive robot which performs predetermined actuation according to the directions from a 
user. A robot 5 has a function as shown for example, in the following (1) - (5) as fundamentally 
ability. 

[0013] (1) A robot 5 can have image recognizing ability and a speech recognition function, and can 
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perform a dialogue with a user. (2) A robot 5 can move or lean a head free according to the 
directions or the self intention from a user. For example, a robot 5 can do dancing a dance etc. by 
moving about free or manipulating a head and the wheel section free based on self intentions 
(program incorporated beforehand). (3) A robot 5 can perform predetermined actuation in response 
to directions by the dialogue from the user who is present in near. For example, a robot 5 can turn the 
electric power switch of TV on and off in response to directions with voice from a user. (4) A robot 
5 can read out the contents of the mail which received the electronic mail and was received to a user. 
Moreover, a robot 5 can also display the contents of the received electronic mail on TV etc. (6) A 
robot 5 can picturize a perimeter and can transmit to the portable telephone in which a user has the 
image pick-up data with an electronic mail. 

[0014] The interactive robot which has such fundamentally ability is realized as "a personal robot 
R100" in NEC Corp. Next, a robot's 5 configuration is explained. 

[0015] Drawing 3 is the block diagram showing a robot's 5 configuration. The robot control section 
51 which a robot 5 becomes from an information processor etc., and the communications control 
section 52 which transmit and receive information between personal digital assistants 1, The image 
pick-up section 53 by a CCD camera etc., and the sensor 54 which consists of a temperature sensing 
sensor etc., The infrared communications department 55 which transmits the infrared signal used for 
actuation of home electronics 6, 7, and 8, the migration and the attitude control section 56 (device 
control section) which control a head 57 and the wheel section 58, a loudspeaker 61, and a 
microphone 62 are carried. A head 57 is established in a robot's 5 idiosoma upper part, and the wheel 
section 58 is formed in a robot's 5 idiosoma lower part. Moreover, the image pick-up section 53 is 
formed in a head 57 (refer to drawing 2 ). In addition, the infrared communications department 55 is 
an example of a control unit which operates an operated device. 

[0016] The robot control section 51 inputs the information from the personal digital assistant 1 
received in the communications control section 52, inputs the image data picturized in the image 
pick-up section 53, and inputs the detection information detected by the sensor 54. Moreover, the 
robot control section 5 1 outputs information required in order to transmit an infrared signal to the 
infrared communications department 55, and outputs information required in order to control a head 
57 and the wheel section 58 to migration and the attitude control section 56. Migration and the 
attitude control section 56 also contain driving parts, such as drive circuits, such as an amplifying 
circuit, and a motor. 

[0017] Drawin g 4 is the block diagram showing the internal configuration of the robot control 
section 51. The robot control section 51 has the image recognition section 512 which performs image 
recognition from the image data inputted as the main control section 51 1, the speech recognition 
section 513 which performs speech recognition from the inputted sound signal, the storage section 
515 which consists of record media, such as semiconductor memory, and the speech synthesis 
section 514 which synthesizes voice using the data memorized by the storage section 515. In 
addition, the main control section 51 1, the image recognition section 512, the speech recognition 
section 513, and the speech synthesis section 514 are realizable with an information processor and 
software, such as a microprocessor. Moreover, the image recognition section 512, the speech 
recognition section 513, and the speech synthesis section 514 can also realize hardware. 
[0018] In the robot 5, the loudspeaker 61 is installed in the part equivalent to opening of a head 57. 
Furthermore, it has a pattern library of operation in the storage section 515, and according to the 
recognition result of the speech recognition section 513 or the image recognition section 512, the 
detection result of a sensor 54, etc., the robot control section 51 reads the pattern of operation 
decided beforehand from a pattern library of operation, and according to the read pattern of 
operation, directions are given to migration and the attitude control section 56, or it gives directions 
to the speech synthesis section 514. Migration and the attitude control section 56 control a head 57 
and the wheel section 58 according to directions. Moreover, the speech synthesis section 514 
generates voice according to directions, and outputs it to a loudspeaker 61. The directions given to 
migration and the attitude control section 56 according to the read pattern of operation are directions 
to which the wheel of the leg is moved as if they danced the dance, and the directions given to the 
speech synthesis section 514 according to the read pattern of operation are the directions which 
generate the response to the question recognized in the speech recognition section 513. Thus, the 
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robot 1 also has the autonomous operation function. 

[0019] Next, actuation of the remote control systems by this invention is explained. A user registers 
beforehand the user name, password, and person image which are information required for a user's 
authentication in a robot 5. A robot 5 accumulates such information in the interior of the storage 
section 515 as a record for every user. When a microphone 62 catches the voice-told message from a 
user and the main control section 511 makes the speech recognition section 513 specifically analyze 
the contents of the voice-told message, a user name and a password are acquired as data, and it 
accumulates in the interior of the storage section 515. Moreover, a robot 5 picturizes a user's person 
image using the image pick-up section 53, and stores the image pick-up data in the storage section 
515. 

[0020] It has the function to operate home electronics 6, 7, and 8, and a robot 5 can control home 
electronics 6, 7, and 8 according to the directions from a user. A robot's 5 robot control section 5 1 
stores the remote control (remote control) data for generating an infrared signal required for 
actuation of home electronics 6, 7, and 8 in the interior of the storage section 515, and, specifically, 
outputs the remote control data which read and read remote control data required for remote 
operation from the storage section 515 to the infrared communications department 55. The infrared 
communications department 55 generates an infrared signal using remote control data, and transmits 
to the home electronics for remote operation. 

[0021] Next, remote control of the robot 5 by the user is explained. A user inputs the telephone 
number currently assigned to the robot 5 from the control unit 12 of a personal digital assistant 1, 
and accesses to a robot 5 by performing call origination actuation. A personal digital assistant 1 
transmits a call request to the radio network 3. By the robot 5, the communications control section 52 
receives the call-in signal from the radio network 3. Then, the main control section 51 1 attests a user 
first. Drawin g 5 is a flow chart for explaining the authentication processing which the main control 
section 511 performs. In addition, in the processing shown in dra wing 5 , although authentication 
processing with a password is also performed, only person authentication by the image may be 
performed. 

[0022] The main control section 511 always judges the existence of access from the outside (step 
S201). If it recognizes that the main control section 511 had access from a personal digital assistant 1 
"person authentication is performed. Please enter a password. A user is notified of the voice-told 
message which the speech synthesis section 514 was made to generate the voice-told message for 
requiring the password input like ", and was generated through the communications control section 
52, the radio network 3, and a personal digital assistant 1 (step S202). A user enters a password into 
the control unit 12 of a personal digital assistant 1. A personal digital assistant 1 transmits the 
entered password to a robot 5. In addition, a robot 5 may transmit the screen and alphabetic data to 
which the input of a password is urged to a personal digital assistant 1 . 

[0023] By the robot 5, the main control section 511 enters the password which the communications 
control section 52 received from the personal digital assistant 1 (step S203). The main control 
section 511 performs authentication with a password by comparing the entered password with the 
password beforehand registered into the storage section 515 (step S204). In addition, a user enters a 
password with voice and a robot 5 may be made to recognize a password by speech recognition. 
[0024] If a password is in agreement, the main control section 511 will notify the voice-told message 
which requires transmission of the person image data like "send a person image" to a user (step 
S205). A user picturizes the person image of self using the camera 13 with which the personal digital 
assistant 1 is equipped. A personal digital assistant 1 transmits person image data to a robot 5. In 
addition, a robot 5 may transmit the screen and alphabetic data to which the image pick-up of a 
person image is urged to a personal digital assistant 1 . 

[0025] By the robot 5, the main control section 511 inputs the person image data which the 
communications control section 52 received (step S206), and gives the person image data to the 
image recognition section 512 (step S207). The image recognition section 512 performs person 
recognition by the person image by comparing the person image data memorized inside the given 
person image data and the storage section 515. And the image recognition section 512 outputs the 
information which shows whether the authentication by the person image was successful to the main 
control section 511 as an authentication result. 
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[0026] The main control section 511 acquires an authentication result from the image recognition 
section 512 (step S208), and judges whether the authentication by the person image was successful 
(step S209). When authentication by the person image is successful, the main control section 511 
notifies the voice-told message of the purport that the authentication like "authentication was 
successful" was successful, to a user (step S210). In addition, a robot 5 may transmit the screen and 
alphabetic data showing authentication having been successful to a personal digital assistant 1 . 
[0027] When authentication with a password goes wrong, the main control section 511 performs 
processing from step S202 again, after notifying the message which shows what the authentication 
with a password went wrong to a user (step S21 1). Or a circuit is cut. Moreover, when authentication 
by the person image goes wrong, the main control section 511 performs processing from step S205 
again, after notifying the message which shows what the authentication by the person image went 
wrong to a user (step S212). Or a circuit is cut. 

[0028] After authentication is completed, the robot control section 51 will be in the condition of 
accepting the command from a personal digital assistant 1 . For example, the robot control section 5 1 
notifies that to a personal digital assistant 1 through the communications control section 52 and the 
radio network 3, when the electronic mail addressed to a user is received. If a user inputs the 
command of electronic mail read-out into a control unit 12 according to a notice and a command is 
transmitted to a robot 5, the robot control section 51 will read the electronic mail information stored 
in the interior of the storage section 515, and will transmit to a personal digital assistant 1 through 
the communications control section 52. The electronic mail may contain not only text but speech 
information and image information. Thereby, a user can peruse the electronic mail addressed to 
himself from a going-out place etc. by using a personal digital assistant 1 . And a user transmits reply 
information to the electronic mail, and when it orders so that it may memorize, the robot control 
section 51 accumulates the reply information in the storage section 515. Moreover, the robot control 
section 51 may accumulate the message information from other users in the storage section 515, and 
may transmit message information to a personal digital assistant 1 by the same processing as 
transmission of the above-mentioned electronic mail. Message information may also contain speech 
information and image information. 

[0029] A user can do remote control of the robot 5, and can also observe the situation in **. In that 
case, a user inputs an image pick-up command from the control unit 12 of a personal digital assistant 
1. An image pick-up command is transmitted to a robot 5, and the robot control section 51 inputs the 
image pick-up command which the communications control section 52 received. Moreover, a user 
can do remote control of the robot 5, and can also operate home electronics 6, 7, and 8 by remote 
control. In that case, a user inputs operator command from the control unit 12 of a personal digital 
assistant 1 . Drawing 6 is a flow chart for explaining actuation of the image pick-up in the main 
control section 511 of the robot control section 51, migration and home electronics 6 and 7, and 
actuation of eight. 

[0030] The main control section 511 outputs image pick-up directions to an image pick-up from a 
user to the image pick-up section 53 according to a command (step S301). The image pick-up 
section 53 picturizes an indoor situation, and outputs image pick-up data to the main control section 
51 L The main control section 511 inputs image pick-up data (step S302), and transmits to a personal 
digital assistant 1 (step S303). A personal digital assistant 1 receives the image pick-up data 
transmitted by the robot 5, and displays the image based on image pick-up data on a display 11. 
Thereby, a user can observe the situation in ** out of**. 

[0031] Moreover, a user can give the command of migration while giving a robot 5 the command of 
an image pick-up. For example, the command for changing migration of a robot 5 and a posture is 
inputted into the control unit 12 of a personal digital assistant like "advance, retreat, clockwise 
rotation, anticlockwise rotation, neck lowering, and neck raising ..." to see the image in ** displayed 
on the display 11, and change an image pick-up part. Each command corresponds to the key decided 
beforehand. That is, it is decided as for example, the "2" keys are pressed to move forward, and the 
depression of the "0" keys is carried out to retreat. A command is transmitted to a robot 5 through the 
radio network 3. The robot control section 51 outputs the directions of operation according to the 
command for changing migration and a posture to migration and the attitude control section 56. 
[0032] Furthermore, a user can also give a robot 5 the command for operating home electronics 6, 7, 
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and 8. In that case, the depression of the key in a control unit 12 decided beforehand is carried out. 
For example, when making the power source of home electronics 6 turn on, it is decided as the 
depression of "#", "6", and "1" is carried out. 

[0033] In addition, a user can also input a command with voice. The case where the command with 
voice is made is hereafter made into an example, and it explains. 

[0034] By the robot 5, the speech recognition section 513 judges by speech recognition whether like 
"the advance, the retreat, the clockwise rotation, the anticlockwise rotation, neck lowering, and neck 
raising" from a user, the voice-told message about migration of a robot 5 and a posture was received, 
or the voice-told message about actuation of home electronics 6, 7, and 8 was received (step S304). 
[...] 

[0035] The main control section 511 judges whether the contents of directions from a user are the 
things about migration of a robot 5 or a posture based on the decision result of the speech recognition 
section 513 (step S305). In being a thing about migration or a posture, the main control section 511 
gives information required for migration or posture adjustment of a robot 5 to migration and the 
attitude control section 56 (step S306). Migration and the attitude control section 56 control a head 
57 or the wheel section 58 according to the information given from the main control section 511. 
When directions are not the things about migration or a posture, the main control section 511 judges 
whether the contents of directions are the things about actuation of home electronics 6, 7, and 8 (step 
S307). When the contents of directions are related with actuation, the main control section 511 
performs control about actuation (step S308). About the control about actuation, it mentions later. 
Moreover, when decision at step S307 or step S304 is negative, the main control section 511 
performs actuation from step S301 again. 

[0036] Thus, a user sets personal digital assistant 1, and he can observe an indoor situation, moving a 
robot 5. Therefore, a user can move a robot 5 in the direction of the home electronics for remote 
operation, and can operate home electronics by remote control from a personal digital assistant 1 . 
[0037] Next, a user explains the actuation which operates home electronics 6, 7, and 8 by remote 
control with voice from a personal digital assistant 1 . Here, the case where home electronics 6 are 
operated by remote control is made into an example. Draw ing 7 is a flow chart for explaining the 
actuation actuation in the main control section 511. 

[0038] A user notifies the voice-told message of a purport which directs the actuation like "wanting 
to operate by remote control" from a personal digital assistant 1 to a robot 5. If it recognizes having 
received the voice-told message about actuation by processing of step S307 mentioned above, the 
main control section 511 will perform actuation about remote operation. 

[0039] The main control section 51 1 notifies the voice-told message which requires the input of 
information required for remote operation of "What is the device operated by remote control? What 
setup to carry out" to a user (step S401). A user notifies the voice-told message for directing remote 
operation of "home electronics 6, switch-on", etc. through a personal digital assistant 1 to a robot 5. 
By the robot 5, the speech recognition section 513 inputs the voice-told message (step S402), and 
analyzes the contents of directions from a user (step S403). 

[0040] The main control section 5 1 1 reads remote control information required for the actuation 
according to the analysis result which inputted and (step S404) inputted the analysis result from the 
speech recognition section 513 from the interior of the storage section 515 (step S405). Here, the 
main control section 5 1 1 reads remote control information required in order to turn ON the switch of 
home electronics 6. And the main control section 511 outputs the remote control information to the 
infrared communications department 55 (step S406). The infrared communications department 55 
generates the infrared signal for turning ON the switch of home electronics 6 based on the remote 
control information, and transmits to home electronics 6. Home electronics 6 turn ON a switch 
according to the infrared remote signal. 

[0041] In addition, although the case where the switch of home electronics 6 was turned ON was 
illustrated, remote operation is not limited to ON of a switch here. For example, when home 
electronics 6 are air-conditioners, a user can perform a temperature control using a personal digital 
assistant 1. Moreover, when home electronics 6 are VTRs etc., reservation status etc. can be checked 
through a robot 5. In this case, the reservation check command of VTR is inputted in a personal 
digital assistant 1, a robot 5 displays reservation status on TV etc. by transmitting the infrared signal 
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for a reservation check according to a command, and a user picturizes that situation screen, and 
transmits to a personal digital assistant 1. Then, a situation screen is displayed on the display 1 1 of a 
personal digital assistant 1. Therefore, a user can check reservation status in a personal digital 
assistant 1. 

[0042] As mentioned above, through a personal digital assistant 1 and a robot 5, a user can observe 
an indoor situation and can move a robot 5 with the directions from a personal digital assistant 1 . 
And a user can operate home electronics by remote control in a personal digital assistant 1, looking 
at an indoor situation. For example, a user moves a robot 5 in the direction of the home electronics 
for actuation according to the command from a personal digital assistant 1, and in a personal digital 
assistant 1, it can operate by remote control, looking at the situation of the home electronics for 
actuation. Moreover, a robot can be moved or a user can also make a posture adjust so that the light- 
emitting part in the infrared communications department 55 may turn to the direction of the home 
electronics for actuation. In addition, a user inputs the command of termination of operation in a 
personal digital assistant 1, and when the main control section 511 receives termination directions of 
operation, it ends actuation. 

[0043] In these remote control systems, when abnormalities, such as a fire, occur in **, a user can 
recognize that in a personal digital assistant 1 . Drawing 8 is a flow chart for explaining the 
abnormality notification action in the main control section 5 1 1 in the robot control section 5 1 . The 
sensor 54 with which the robot 5 is equipped detects the indoor temperature rise by the fire, and 
outputs the detection information to the main control section 511. The main control section 511 
recognizes that abnormalities occurred indoors based on the detection information from a sensor 54 
(step S501). 

[0044] The main control section 5 1 1 performs call origination processing to a personal digital 
assistant 1 by controlling the communications control section 52 (step S502). If it detects that arrival- 
of-the-mail actuation was made in the personal digital assistant 1, a robot 5 will transmit the voice- 
told message which shows the abnormal occurrence of "the fire broke out" to a user to a personal 
digital assistant 1 (step S503). At this time, the main control section 511 may also transmit the image 
which the image pick-up section 53 picturized to a personal digital assistant 1. 
[0045] Thus, a user can recognize the abnormalities caused in ** from the going-out place etc. 
through the personal digital assistant 1 , and can lecture on the measure which should be taken [ carry 
out / to a fire department etc. / a fire outbreak report ] quickly. Moreover, a robot 5 may perform the 
notice of an abnormal occurrence by transmitting an electronic mail etc. to a personal digital 
assistant 1 . Furthermore, a robot 5 may notify the notice of a fire outbreak to a security company etc. 
with notice means, such as a telephone and an electronic mail. 

[0046] Here, although the case where a fire broke out indoors was explained to the example, even if 
it is the case where abnormalities other than a fire occur, a robot 5 can perform the notice of 
abnormalities to a personal digital assistant 1 by the above-mentioned processing and same 
processing. For example, when the infrared sensor for detecting invasion of a suspicious person in a 
sensor 54 is extended, a robot 5 can detect invasion of a suspicious person by the sensor 54, and can 
notify the information to a user. 

[0047] As stated above, according to the gestalt of this operation, a robot 5 has communication 
facility with a personal digital assistant 1 , can perform a dialogue with an image or voice with a user 
through a personal digital assistant 1 , and can perform various actuation based on directions by the 
dialogue. Therefore, a user can give a robot 5 directions of operation from a going-out place etc. by 
using a personal digital assistant 1 . 

[0048] Moreover, a robot 5 has beforehand the function of remote control to operate home 
electronics 6, 7, and 8, and operates home electronics 6, 7, and 8 by remote control using the 
function of required remote control according to the directions from a personal digital assistant 1 . 
Therefore, a user can operate home electronics 6, 7, and 8 by remote control from a going-out place 
etc. by using a personal digital assistant 1 . Moreover, a user can also carry out by putting in block 
remote operation of home electronics 6, 7, and 8 using a personal digital assistant 1. 
[0049] In order to realize such a remote-operation approach, to a robot 5 The analysis feature which 
analyzes the command received through the radio network 3 from the personal digital assistant 1 (the 
image recognition section 513 and speech recognition section 514), The device control function 
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which controls the wheel section 58 and the head 57 for migration based on the analysis result by the 
analysis feature (part which controls the software part in migration and the attitude control section 
56, and the migration and the attitude control section 56 in the robot control section 51), The image 
transmitting function which addresses the image picturized and obtained to a personal digital 
assistant 1 based on the analysis result by the analysis feature, and transmits (control section of the 
communications control section 52 in the robot control section 51), The program for realizing the 
actuation function (control section of the infrared communications department 55 in the robot control 
section 51) to operate an operated device based on the analysis result by the analysis feature is built 
in. 

[0050] Since a robot 5 operates home electronics 6, 7, and 8 by remote control using an infrared 
signal, he is unnecessary. [ of the cable-connection between a robot 5 and home electronics 6, 7, and 
8 ] Therefore, the structure of a system becomes simple, and a user can maintain a system easily 
while being able to hold down the introductory cost of a system at a low price. Moreover, if home 
electronics 6, 7, and 8 support infrared remote control, it can operate by remote control, and since the 
actual condition is that many home electronics etc. support infrared remote control, the remote 
system by this invention has the advantage of excelling in versatility as compared with the 
conventional remote control systems as shown in drawing 10 . 

[005 1 ] Furthermore, a robot 5 has the function which picturizes an indoor situation and is transmitted 
to a personal digital assistant 1 . Therefore, a user can do the remote monitor of the indoor situation 
using a personal digital assistant 1. And a user can operate home electronics 6, 7, and 8 by remote 
control in a personal digital assistant 1, looking at an indoor situation. 

[0052] Moreover, since a robot 5 notifies the purport of an abnormal occurrence to a user through a 
personal digital assistant 1 when abnormalities, such as a fire, occur in the interior of a room etc., a 
user can lecture on the measure which should be taken quickly from a going-out place etc. 
[0053] In addition, although illustrated about the case where a user directs to a robot 5 by the 
dialogue, with the gestalt of the above-mentioned operation, the directions gestalt is not limited to a 
dialogue. For example, a user can give directions to a robot 5 by keying the corresponding number in 
a personal digital assistant 1. Moreover, a robot 5 can transmit screens (for example, screen for 
choosing the home electronics operated by remote control etc.) for a user to input a command to a 
personal digital assistant 1, and can also receive as directions the information chosen on the screen. 
[0054] Moreover, a user may use not only voice but an image, and may perform a robot 5 and a 
dialogue. For example, a user can perform the dialogue which used voice and an image among 
robots 5 by a personal digital assistant 1 transmitting the image data which shows a user's person 
image to a robot 5, and transmitting the image data a robot 5 indicates image images (image showing 
a robot's 5 expression etc.) to be to a personal digital assistant 1. 

[0055] Furthermore, since the robot 5 has the autonomous operation function, he can function also 
not only as the reason of remote operation but as a domestic pet robot. 

[0056] Next, the gestalt of operation of the 2nd of remote control systems is explained. A user can 
operate home electronics by remote control from a personal digital assistant 1 by making it a system 
configuration as shown in drawing 9 , although the gestalt of the 1st operation explained the case 
where home electronics were operated by remote control when a user operates a robot 5, without 
being based on a robot 5. Drawing 9 is the block diagram showing the configuration of the 2nd of the 
gestalt of operation of remote control systems. 

[0057] The remote control systems shown in drawin g 9 have the composition that home electronics 9 
are connected to the subscriber telephone terminal 25 into **. Therefore, a personal digital assistant 
1 is connectable with home electronics 9 through the telephone line of communication network 
(radio network is also included in network.) 3 A, such as a dial-up line network, and a cable. 
Moreover, home electronics 9 have an interface function with the telephone line. In addition, home 
electronics 9 may be the configurations which are connected to the telephone line or are connected to 
the telephone line as a cordless handset of telephone through the switcher which connects either of 
the telephones (not shown) and home electronics 9 in ** to the telephone line. 

[0058] Hereafter, the actuation in the remote control systems shown in drawing 9 is explained. Here, 
home electronics 9 are set to VTR and a user explains to an example the case where image 
transcription reservation is performed. A user connects to home electronics 9 through 
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communication network 3 A using a personal digital assistant 1. And a user keys the number for 
starting image transcription reservation in a personal digital assistant 1 . 

[0059] Then, home electronics 9 transmit the input of required information to a personal digital 
assistant 1 through communication network 3 A at image transcription reservation. For example, 
home electronics 9 transmit a message with voice, such as "please input image transcription start 
time", to a personal digital assistant 1. A user keys information required for image transcription 
reservation of image transcription start time etc. in a personal digital assistant 1 according to a 
message. And home electronics 9 perform image transcription reservation based on the information 
inputted in the personal digital assistant 1 . 

[0060] If it is made a configuration as shown in drawing 9 as shown above, a user can operate home 
electronics 9 by remote control from a personal digital assistant 1, without through a robot 5. That is, 
a user can operate home electronics 9 by remote control, without conversing with a robot 5. 
Therefore, since a user can operate home electronics 9 to a personal digital assistant 1 by remote 
control freely and can operate by remote control by user initiative, he is wide opened from the stress 
concerning actuation. 
[0061] 

[Effect of the Invention] According to this invention, while remote operation of the facility in ** is 
realizable by the low price, the program in the remote-operation approach that the addition function 
of the remote monitor and others in ** is easily realizable, remote control systems, and Remote 
Control System can be acquired. 



[Translation done.] 
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9) ♦ AttftteJr^fiSSE^tiWlUfcJfl&ccii, ^s^DS 

5 i itt, r«gsEAs.«jjju*ofc« j ti^tc&^um 



(5) 4ttB2 0 0 2-2 6 156 7 

(Af ?^S2 10). tefc, otf"? h5tt. aflliE 

aai/r<>j:ir>. 

[ 0 0 2 7 ] / < 7s o - FK J: £gg§E#&fl* L/ fc« 
it. 2H&IS5 1 lit, ;to9-FK*4IHBMMkU 

fcc£&^> ^if-y*a-ifK:*ii/ra*!Lfca 

(^^5-7'S2 1 1 > , x^7^S2 02*6««i* 

R*jBfr& t ifcit, mm&qmtZo a*« 

io tcjriBgiE^SUfc^ec^ ±Hiftf«5 1 lit, A 
J: &ISS^tt O/c C i Sr^-f > -b - * * * - 
irtCtttiTa&lt/fcfi (XfyfSZ 1 2) t 
S2 0 5*&©MM!W*fT** i Sfeit, 0SS4^ 

[ 0 0 2 8] KB*»7 U&a, D# 9 h *IJ«5 1 

it. mmfe\&t>w^*&#}jb&ttic&&. « 
x.ct. p«k? hBOM5 i-if^ro^>-.'L 
««ii/-Cl**«diCtt. ii(I*l»5 2 i$ j:^««a 
(I* ^ h -? - * 3 */r^44>B*84|H8$ 1 ^ii^Of 

CrilfMl 2KAAU HMW*0*» h5Kieisn& 
t. d*^ tBIWB5 lit. aa«ac5 1 sortttettM 

» i/'caatKffi«:iSft i/. ear** 

1 5i<:SSf JJAi, h*JjMg|l5 lit. 

■*iccjn, , ciato'c4*c*. e*iMtt t 

[ 0 0 2 9] i-^it, a*? ^ 5 ^iSH$teLT^ 

^it. 1 ^fTSIl 1 2*6«W5**A*T 

ttftffi^u^? h5ecjStt$n. a^^hlMM 
40 5 1 it, afiSflflW 5 2 ^ff U tcMfflft* Ktt 
Z>. Sfc, a— frit, 0*?h5*aiVtML/CMIl 
q° P 6. 7. 80iMUMFttff>C&^ < Cft&. *«■ 
^. it. piUlt, jS^g*i©feff^l2^6S 
B6tt. 0^^ hHM5 14>±M 
aiS55 1 lcctoM4iM. t?ttfeJ:^sK« D B 6. 7. 
8 <D\M£0>tbfi tHf -5 ^ci«W7 n - * * - h X'*> 

[ 0 0 3 0 ] £MM5 1 1 it, Ji-lW^OJRSKiS 

50 iXf-?7SZ 0 1 ) o *«*5 3i*. Srttt^^S^ 
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9 

(./. afltf^fc^WaajS 1 l KHiOTttMrra. £ 
WMV5 1 1 &. Jgftr-^^AAO (Ar^'^S3 0 

2 ) . fc!F$£;fc 1 Kj* L,xmiE? 4 i *r v 7"S 3 G 

3 > • femm. i k, o*** h s Mas $nfc»«f 

K*Rr4. CtitcjiO. a-fli. ^ffcfci^c, % 
[ 0 0 3 I ] t fc, a-tf 41 p sK 9 h 5 
«U4*, icamu itct^snte^craMrft-c, S 

£ttB, IT(f. »±tf- * - J «©«fc5lC, Q^; h 

r 2 j *-&iPTU. f£jl3ttfcl'*I*E4* 

««. jmkm* ? ^ ? - * 3 */r i/T d * ? h 5 kg 

[0032] 3 i— «t, l?«^ q D P 6, 7, 8£ 
*ffT4fcift©IB**D#* ^ 5(C5it4CfcVca 
4. 4©*S£. ttfftfl 2KfcW4fa&fcft&ft'a*4 

4tt£ccii. r#j , re j , rij«rFr*ti-* 

J:5Kfc«>6fVCt*4. 

[0 03 3] a*, a-m flHteft^-cAft-rtc 
*4pJttr*4. kt, **KJ:4*ft#&$ft4*S£ 

[ 0 0 3 4 ] a* ? h 5 'C41 *MBii!»5 1 3 i 

rairat. Kii. eis. xtem* «rtf, m 

±cf • - ■ j e©£*cc. h&©«IM*J:0£lt 

A6. 7. 8©aftlCl*T4*^**-i>«mi*fe 
**** % *#seaft(C J: -> -C«Kr a (Af^S30 
4> . 

[ 0 0 3 5 ] 2HHM5 1 1 li, *J*HHB5 1 3©*H 
Ktt*tc»-^c»*c Jt-^6«>«5Vi«^P*!? h 5© 

93 s fc \mmm? 4 h <ov*> h&m>&mt& 

*4«dcci*. i$Uiai^5 1 lit, M-SJMMM5 
6fc*k,rD** h 5©«M*fcl£fffMBcC!fW&tt 
ffi£5*4 (^^?7S306) o - «J6Wtftt5 
64*. £*Kiftg»&! l^^^nfctttttcato-CSM 

niFWtfftssf&e. 7, 8©fMPcHT4<>©TN&4 



TO «BB2 0 0 2-2 8 1 56 7 

10 

Hftp «t ^ ( * * 7* s 3 o 8 > o mttcm? a nunc 

mLX\ffi&t6o £tc. a**:/S30 7*fci*Af 
? 3 0 4 ^CD«fc»5*»-C*4«dK:tt. £«H) 
$5 1 lit, *?7 7S3 0 1*6©ttE*fl&gTTT 

4. 

[ 0 03 6] C©£^(C. a-ifl*. S^HS* 1 fcl* 
[ 0 0 3 7] ifcK, 1 J: ^ 

f 4. cctw. 6 &&m*m t>mz*Giic 

f 4 fe«>©7 u - * t - h -c*> 4. 
[ 0 0 3 8] a-^ii, K4|Ma^ l D * * h 5 tc*f 

S 3 0 7 ©WB'rtMf ccBfa*^ > ^-^Si O 
20 AiCi*ag3iTa<t, ^i»5 1 1 41 ^nfi^tcra 
*a*fp«rff5. 

[ 0 0 3 9] £MM5 1 1 li, raFSfefff aws 
»b-ca*ra (Ar^S40 i > • fe^ 

lit* 1 (./X r^Ua 6 , ?*<0£ *> 

3 *J. *©**> *fe-i>€:AA UiXT? y'S 4 0 
30 2 > . i-1^^©tSnW««r«?#rr a < Xf v 4 
0 3 ) 0 

[ 0 0 4 0 ] SHKM5 1 1 tt. #*S8«»5 1 3»>f5> 
RffM<rAAU (at ^ 4 0 4 ) , AfiOtcmVi 
ttJR^Ufcttff(Cd^iJ«a>M«<:ettMi5 1 5 
©PlSW*^S*fflT (^■;7S4 0 5) o CC^Clt, 
^J»5 1 144, l^Se©;^ ?f4*>W4 

UXOMti < ^ 7 S 4 0 6 ) . WM3MW5 5 
40 it- «©'j*3>ff»IR4cg^i*r**fiaUii6©^^??- 
4te«>©i»f«Ui***«Lr % ^*§?q D P 6 

[ 0 0 4 1 ] ttfe, C CC4*, ie^SJS6©^^ ^ 
4-><cr4*d€Mft^ca»s v ifiHt*mt, X^ 7 ^© 
af-XCHCStiaC'. Hit tf. Se®i?a6^i7=s>r' 

«r!fofc0"raci^r'*ao sfc. mkas^vt 
so si^ract^cBao c©^, a-^tt, 
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[ 0 0 4 2] Oh©* W». 1 to J: 

ow? tseao-c, ^fWs*sst*c<l^t? 

* . m&x. 1 *6Q*S««: J: -? -CD*? F 5 

[0043] c<o&&mt*<zruckz, *rtic*i*r 

? hHM5 1 Kfcl*6£Stt*5 1 1 KfcW4JMfil 
h 5t£tf il6ft a tt*6fe>?5 41*. *.&£J:4Srtcr> 
ttU'CS^f*. £*ij©S[i5! II*. <fe>?5 4;»>feG> 

[ 0 0 4 4] SIMMS 5 1 1 (*, ]i(lim»5 Z 

>' 9 Hz-*>£S5£ig£ i ( 2r ? 7 S 5 0 

3) t C0>t*. ££»S|J5l 11*. tRft«5 3*4Bft 

1 0 0 4 5 ] C (OX *> «C. a~--?t*. 1 £/ri/ 

aBit«:ttr«C^t t ««. *fc, K5i*. *S# 

3«S4a*i*« wf> -juwastfwc j: ->r* 
dlft ttVcctt 1/ -ca* L/C 4 J: 
[ 0 0 4 6] CCtit £ftK^#£*l,fcig££« 
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fc. Dtf?l*5i*, ±E©jaH^HtlfiC«8HC*orl$ 

sw^icc^Lrpsaaw^ctdi-c**. pj* 
i*. -fe 5 4 <cT^*ccaA«rfta-r & tcvxom sa 

[ 0 0 4 7] ObteflS^fc^Ki, **fc<W£S«: J:n 
I*. oK? h5tf, te^;fu £<PiIfI»tfe*?!U ft 

^CW^. {W;. *-ift*. ttttU«l*Jfl 

[00481 *&, D#^5tt, 8SKA6. 7. 8 

A8. 7, 8CDamtfff:tf9. i-1«*, 

7. 8a>ttMllff<rff9C&^-C<r«. S 
20 fe. ^-^l*. S^iS*l «M^r*«HA6. 7, 8 

[ 0 0 4 9] «©J: ^ va^ff^^SJlf^^ 

mmh i zte&v^wmmh 1 4 > t, &&<otc$> 

<D*iMB5 8^>H»5 7 eiWilttK J:««WttXK:«> 
^^tr^rMarrftWIMMtt (W> •«»HW»5 6 

? hM5 1 (e«5^«afl«WS5 ZQ>Wm&) 

[ 0 0 5 0 ] h 5v*. aS?f«m^4Qt^*SlS 

A6. 7. SCSnSfffctT^T?. P^^5i^ 

KA6, 7, 8 ^^Baomem^tAti:. 7fft?*« 0 

tc. A©JB ! ***JI«:?T^Ci# , C *fc. 
.««SUL6, 7. 8l**^« , J J 6 3>(cj#i£0'C(r»ni* 

[0 0 5 1 ] 3 6tC, D^v h 5t*. 

50 «c>. ^-^t*. Rmticni't. srti*s^ans 
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[ 0 0 5 2 ] * fc, D # * h 5 it, <A9(C«v »"C*S8 
[ 0 0 5 3 ] ft 4), ±ia<C^lfe<D^S'Cli, i- 1W» 

*A*tf afcacaiffl &ffi»ff?&s«SA 
*aft? 6fcaMH]B«> tttWKlntcaai/. 

[0054] *&, i-trtt, ^©*&fcrm»fcJ8 

* 1 WAWMtSIWl^- #*0#*h5Ki 

OltlS^fcg-f iSfl«?> $ i 

KHat/caOTictr. p* 9 h stcoE] 

[ 0 0 5 5 1 3 6«c, Dtf 9 V 5 ti. BIMMMMtW 

? hu^-; YtisXbtttf&r&Ct&XSho 
[ 0 0 5 6 ] A«iff^f L QfttlKHB 

o* 9 h 5 *»fW* C tic J: r**NAMknttff 
£tr 5 i^cco^-cg^ U fctf, 13 9 «MW J: * ft 

j:*Ttc, tssas* i mar.* mmft? ZCt 

[0 0 5 7 ] BQtcSTawiftfft/*?'*!*, ^FSicfc 
SSflft taail* ? h 7 - * ( * * h -? - *fiKSW 40 

an*? ^-^ddden^. > 3A4dj:tfwefi©s» 

MA 91*. S»^±Q4 

[ 0 0 5 8 ] «T, B9«:waia»fPS/XfAK:jaW 
*ftf¥Kl^^-C8BWr&. CCT'li. ^tSq G e 9?:VT 



Page 1 of 1 



tiH2 0 0 2-2 8 156 7 

14 

3 & WtL,X&n&&9lC*iL<XW&t:ft'> 0 ZLX. 

*—ra, *hhb*i 'imf-mmfethtc 

[ 0 0 5 9 ] 1* * t , ItilaUl^ l*. ait 4 * h 7- > 
3 A tft br 1 KSB3^!«ftMfI0AJ7 

fct-A***. t-L/f. £€££9(2, ^^S^ltC 
[ 0 0 6 0 ] K±k:5i Ute J: ^ •£ , @9 cc^f * 9 ft* 

n&s&mimttzctfrX'Zh. z<Dtc#> 

[ 0 0 6 1 ] 

»»*©Afl>rt.fB*tt6*«»Ki^aT^c t^-c**a 
uc mhfayTfJu&ft&ct MX- # ^> 0 

[HiBOmailH!] 

[B2] a^-^ K^^HO-W^^-rs^S-C* 

[B3] d y Y<Dmi&&in?7uy »BVUa 
[B4 ] D?K^ FH»0a>A»tv^^7'P ^ 

[ b 5 ] d 4< ? v *mm>z.fflm^c % w issn 

[B6] ^HKMcc^&iBft. Stt^J:^««S 

[B8 1 £m«tcM!>«HxaaiMF«iRm'& 
[ b 9 ] aHttffvx rjuomz cog&vw&ofe 

[B10] tK*oaHliff^f AOC— ft-Sr^T^D 

^^Br-^>^ 

[l?^02ft^) 

3 «eaae*?h7-^ 
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5 P#?h 

6, 7. 8 $3&fp 

5 1 a#?httW 

5 2 iliUlMB 

5 3 fiff 8» 
5 4 

5 5 Stff eifflCf » 

5 6 • (fiSMWOAl 



*57 
5 8 

5 1 1 

5 1 Z 

5 1 3 

5 1 4 

5 1 5 
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sign 
mil SB 

misuse 




1 r 



[B9] 



x 1 




| S&G6 



* x \ — 

1 " — 

szoe ^^^^ M 



S209 



32t0 



HE) 
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[■?] 



51 



mm 



513 



lags | 

5» 



[06] 



iii^SCraijail/ 5301 




[B8] 



I 



9401 



^3402 



S403 



S404 




I L/-S5G2 

jf— J 



[0 1 o ] 
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*B82 0 0 2-2 8 156 7 



H0 4M 11/00 



3 0 ! 



F ! 

H0 4M 11/00 



3 0 1 



T-73-K ) 



F 2C150 AA14 CAO? CAM CK05 



CK25 CW26 CA27 CK28 O03 
DF04 DFC6 DF33 DK02 ED42 
ED52 EF07 EF13 EF16 EF23 
EF28 EF29 EF33 EF36 
5K02A BB01 CC07 CC11 FF03 FF04 
0003 

5K048 AA04 AA05 B401 D601 D604 
0C01 EB02 EB10 EB13 

5K101 KKU KK12 LL12 NNO? NN03 
NWL8 NM21 
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